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Abstract We investigate, in the setting of a real Hilbert space Tt, the asymptotic behavior, 
as time t goes to infinity, of trajectories of second-order evolution equations 

il(t) + ~fu(t) + V0(w(t)) + A(u(t)) = 0, 

where is the gradient operator of a convex differentiable potential function <f> : TL — > H, 
A : TL — > TL is a maximal monotone operator which is assumed to be A-cocoercive, and 7 > 
is a damping parameter. Potential and non-potential effects are associated respectively to 
V(/> and A. We prove that, under condition A7 2 > 1, each trajectory asymptotically weakly 
converges to a zero of V</> + A. This condition, which only involves the non-potential op- 
erator and the damping parameter, is sharp and consistent with time rescaling. Passing 
from weak to strong convergence of the trajectories is obtained by introducing an asymptot- 
ically vanishing Tikhonov-like regularizing term. As special cases, we recover the asymptotic 
analysis of the heavy ball with friction dynamic attached to a convex potential, the second- 
order gradient-projection dynamic, and the second-order dynamic governed by the Yosida 
approximation of a general maximal monotone operator. The breadth and flexibility of 
the proposed framework is illustrated through applications in the areas of constrained opti- 
mization, dynamical approach to Nash equilibria for noncooperative games, and asymptotic 
stabilization in the case of a continuum of equilbria. 
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1 Introduction 

Throughout this paper, TL is a real Hilbert space. Its scalar product is denoted by 
(, ) and the associated norm by | • |. We wish to investigate the asymptotic behavior, 
as the time variable t goes to +00, of second order evolution equations 
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u(t) + -yu(t) + A{u(t)) = (1) 

where A : TL — > Ti is a maximal monotone operator and 7 > is a positive damping 
parameter. Here and henceforth, a dot ( ' ) denotes first-order differentiation with 
respect to time t, and a double dot ( " ) denotes second-order differentiation. In 
order to grasp the respective influence of potential and non-potential operators in 
such inertial systems, and their effects on the asymptotic behavior of trajectories, 
we consider the class of maximal monotone operators which can be splitted up into 
the sum of two terms A = + A where 

• V(p '■ TC —* TC is the gradient operator of a convex and continuously differen- 
tiable function <j> : TC — * IR; 

• A : TC — > TC is a maximal monotone operator that is assumed to be cocoercive, 
which means that there exists some constant A > such that 

V(v,w)eH 2 (Av - Aw,v -w) > X\Av - Aw\ 2 . (2) 

An operator A : TC — > TC which satisfies ([2]) is said to be A-cocoercive (the relevancy 
of this hypothesis with respect to applications is examined below). Note that A 
A-cocoercive implies that A is (1/A)-Lipschitz continuous. 

An outline of the present work is as follows: 

1. In section 2, we study the asymptotic behavior of second-order autonomous 
evolution systems governed by such operators A = V^> + A, namely 

fi(t) + yu(t) + V(p(u(t)) + A(u(t)) = 0, (3) 

with <j) convex and continuously differentiable, A A-cocoercive for some A > 0, and 
7 > damping parameter. Let us denote by 

5 := {v G TC I V0(«) + Av = 0} (4) 

the set of equilibria and suppose that 5^0. In Theorem 12.11 we establish that, 
under the sole assumption 

A7 2 > 1, (5) 

each trajectory t — * u(t) of ([3]) weakly converges in TC, as t — > +00, to an element 
of S. This condition, which only involves the non-potential part of the maximal 
monotone operator governing the equation, is proved to be sharp, in the sense that 
one can exhibit situations where condition A7 2 < 1 does not ensure convergence of 
all trajectories. 

When the operator + A is strongly monotone we prove strong asymptotic 
convergence of the trajectories. 

In the potential case, A = Vcj) (corresponding to A = 0), taking advantage of 
the fact that, in the above result, no restrictive assumption is made on the potential 
operator V0, we recover the asymptotic convergence result for the so-called heavy 
ball with friction dynamical system (Alvarez [2]) 
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fi(i)+7«(t)+V0(u(i))=O. (6) 

In recent years, because of its rich connections with mechanics and optimization, 
this system has been the object of active research, see [2], [8], [H]> [Hj, and the 
references therein. 

In the non-potential case, V</> = 0, ([3]) becomes 

u(t) +7u(t) +A{u(t)) =0 (7) 

with ^4 a cocoercive operator. Equation ([7]) covers several situations of practical 
interest: 

• A = I — T where T : 7i —* W is a contraction. It can be easily checked 
that A is (l/2)-cocoercive. Condition ([5]) gives 7 > \/2. When specialized 
to this situation, Theorem 12.11 yields convergence results for the second order 
gradient-projection dynamical system, first established in [5] and [8]. 

• A = B\ where B\ (with parameter A > 0) is the Yosida approximation of a 
general maximal monotone operator B : TL — > 2 W , (see [IS]). One can easily 
verify that B\ is A-cocoercive. Noticing that B and B\ have the same zeroes, 
we shall derive new inertial second-order dynamical approach to the set of 
zeroes i?~ 1 (0), for B a general maximal monotone operator. 

2. In section 3, we introduce a Tikhonov-like regularizing term V@(n(t)) with 
vanishing coefficient e(t) in the above dynamic, and consider the nonautonomous 
system 

u{t) + 7 u(t) + V<j>{u{t)) + A{u{t)) + e(i)Ve(u(i)) = 0, (8) 

where the function : TL — > IR is supposed to be convex, differentiable, with V0 
Lipschitz continuous and strongly monotone, while e : [0, +00) — > [0, +00) is a 
function of class C 1 such that e(t) — > + as t — > +00. 

In Theorem 13. 1\ we establish that, under condition ([5]), and the slow vanishing 
condition on e(-) 

r+<x 

/ e(s)ds = +00, (9) 
Jo 

each trajectory of (jSJ) strongly converges as t — > +00 to «*, which is the unique 
minimizer of over the set S := (V(/>+j4) -1 (0). Equivalently, solves the following 
variational inequality problem: find « t eS such that 

(V0(u*),u — u*) > Vv £ S. (10) 

Note that the above regularization technique allows both to obtain strong con- 
vergence of the trajectories, together with a limit which no longer depends on the 
initial data. As a consequence of Theorem 13. 1\ we recover various results which have 
been devoted to the Tikhonov dynamics, see [13], [23] and the references therein. 
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3. In the final section, we briefly outline situations where our results can be 
applied. Indeed, the convergence results obtained in Theorems 12.11 and 13.11 offer 
promising views on numerical optimization and algorithms (by time discretization 
as in [2], [JJ, [12], [22]), on the modeling of inertial dynamical approach to Nash 
equilibria in decision sciences and game theory (see [15], [23]), and on dissipative 
dynamical systems and PDE.'s (as in [6] for the damped wave equation). 

2 Asymptotic convergence results 

This section is devoted to the study of the asymptotic behavior, as time variable t 
goes to infinity, of trajectories of (|3|). 

2.1 Weak asymptotic convergence results 

Throughout this section we make the following assumptions: 

(HI) cf) : Ti — > IR is a convex differentiable function whose gradient V</> is 

Lipschitz continuous on the bounded subsets of Ti; 
(H2) A : Ti — > Ti is maximal monotone and A-cocoercive for some A > 0. 

Note that the cocoerciveness of A implies that A is Lipschitz continuous, so that 
V0 + A is Lipschitz continuous on bounded sets. By Cauchy-Lipschitz theorem, for 
any initial data u(0) = uq, -u(O) = vq with (uq,vq) in Ti 2 there exists a unique local 
solution to the Cauchy problem 

' il(t) + ju(t) + V0(u(t)) + A{u(t)) = 0, 

(11) 

u(0) = uq, u(0) = v . 

The fact that u is infinitely extendible to the right follows from a uniform bound on 
\u(t)\ as given in the proof of Theorem 12.11 which provides a unique classical global 
solution u G C 2 ([0, +oo); Ti) of ([TT]). 

The following theorem establishes the weak asymptotic convergence property of u(-), 
solution of (fTTj) . under the sole assumption A7 2 > 1. 

Theorem 2.1 Let us suppose that (H1)-(H2) hold with S := (V0 + ^4) _1 (0) / 0, 
and that the cocoercive parameter A and the damping parameter 7 satisfy 

A7 2 > 1. (12) 

Then, for each initial data uq and Vq in Ti, the unique solution u G C 2 ([0, +00); Ti) 
of (Q2P satisfies: 

11) There exists Uoo £ S such that u(t) — 1 Uqo weakly inTi as t — > +00. 
Moreover, 

12) ii G L 2 (0,+oo;W); lim t _ +00 \u(t)\ = 0; 

13) il + V(p(u) + Ap G L 2 (0, +00; Ti) whenever p G S; 

14) for every p G S, lim^ +00 \u(t) — p\ exists. 
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Before proceeding with the proof of Theorem 12.14 we establish three technical 
lemmas. The following lemma plays a crucial role in the proof of optimality of the 
weak cluster points of a given trajectory of (fTTI) . Because of its independent interest, 
it is stated in a general setting, the potential being allowed to be non-smooth. We 
use the classical notation d& for the subdifferential operator of <I> (it coincides with 
the gradient operator in the smooth case). 

Lemma 2.1 Let <3? : TL —* 1R U {+00} be a convex and lower semicontinuous func- 
tion, (u n ) a bounded sequence in TL, and p £ TL. If there exist n n £ d&(u n ) and 
fj £ <9<3>(p) such that 

lim (u n -p,rin-V) = °> ( 13 ) 

then any weak cluster point u of (u n ) satisfies 

fj £ d$(u). (14) 

Proof: Set w n = (u n —p, r) n — fj) and introduce the functional F : TL — > KU {+00} 
defined for any v £ TL by 

F(v) = $(«) — - (v -p,fj). (15) 

By convexity of <& and fj £ d<&(p), we observe that F is a convex and nonnegative 
function, and it can be easily checked that 

F{u n ) = $(u n ) - $(p) - (u n - p, rj n ) + w n . 

Therefore, from convexity of $ and rj n £ d<&(u n ), we have 

< F(u n ) < w n , 

which by (|13p (that is w n — * as n — > +00) gives 

lim F(u n ) = 0. (16) 
n— »+oo 

Now consider any weak cluster point u of (u n ), namely there exists a subsequence 
(u nk ) of (u n ) such that (u nk ) weakly converges to u as k — > +00. Then invoking 
the weak lower semicontinuity of F (as it is convex and lower semicontinuous) and 
using (fl~6|) . we obtain 

< F(u) < liminffe^+oo F(u nk ) = lim n _+ +OC) F(u n ) = 0, 

which entails F(u) = 0. This implies that u is a minimizer of the convex and non- 
negative function F, so that £ dF(u), which from (|15p is equivalent to (I14p . • 

Lemma 2.2 Let A : TL — > TC be a maximal monotone single-valued operator and 
(f) : TL — > 1R a convex differentiate function such that S := (V</> + ^4) _1 (0) 7^ 0. 
Suppose that p £ S and (u n ) is a bounded sequence in TL verifying 

(cl) lim n ^ 00 (V(/>(ti n ) - Vcj)(p),u n - p) = 0, 
(c2) lim n ^oo \Au n - Ap\ = 0. 

Then, any weak cluster point of (u n ) belongs to S. 
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Proof: Let u be a weak cluster point of (u n ). From (cl) and invoking Lemma 
12, H we have V0(p) = V0(u). Moreover, from (c2) and recalling that the maximal 
monotone operator A has a graph which is closed in w- TC x s — TL (see [19] for 
example), we have Au = Ap. As a straightforward consequence, V</>(u) + Au = 
V(j)(p) + Ap = 0, so that u 6 S, which completes the proof. • 

The following lemma will be used in the proof of Theorem EH] in order to obtain 
the asymptotic convergence of the mapping t — ► \u(t) —p\, whenever p £ S and u is 
solution of (jllh . This lemma appears implicitly in [2j , its proof is given for the sake 
of completeness. 

Lemma 2.3 If w G C 2 ([0, +oo); 1R) is bounded from below and satisfies the follow- 
ing inequality 

w(t) + jw(t)<g(t), (17) 

where 7 is a positive constant and g £ L 1 ([0, +00); 1R) ; then w(t) converges as 
t — > +00. 

Proof: From (|17p and denoting [w]+ = m&x{w(t), 0}, we classically have 
[w(t)] + <e-^[w(0)] + + tie-^)\g(T)\dT, 

while Fubini's theorem gives us 

r+00 rt 1 f+00 

/ e-^ t -^\g(r)\dTdt = - \g{r)\dT < +00. 

Jo Jo 7 Jo 

This shows that [w]+ £ ^ 1 ([0, +00); 1R). Now setting z(t) = w(t) — f [w(r)]+dT, we 
observe that z{.) is bounded from below (as w(.) is assumed to be bounded from 
below) with z{t) = w(t) — [w(t)] + < 0, hence z(t) converges as t — ► +00, and so does 
w(t). • 

We are now in position to prove the main result of this section. 

Proof of Theorem [2H] Takep £5 = (V0+A) _1 (O) andset h(t) = (l/2)\u(t)-p\ 2 . 
From h(t) = (u(t) —p,u(t)) and h(t) = (u(t) —p,u(t)) + \u(t)\ 2 we obtain 

h(t) + ~ffi(t) = (u(t) - p, ii(t) + 7tt(i)) + \u(t)\ 2 , (18) 

which, by using ([TT]) yields 

h(t) + 7fc(i) + (V0(«(t)) + u(t) -p) = \u{t)\ 2 . (19) 

Recalling that V0(p) + = 0, we deduce that 

fc(t) + 7fc(i) + (V0(«(i)) - V0(p), u(t) -p) + (Au(t) - Ap, u{t) - p) = \u{t)\ 2 . (20) 

Then, by using the A-cocoercive property (J2J) of A, together with the monotonicity 
of V(j), we obtain 

h(t) + 7h(t) + X\Au(t) - Ap\ 2 < \u(t)\ 2 . (21) 
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Regarding the third term in the left side of (I2ip . by using (jlip again, replacing Au(t) 
by-(ii(i)+7u(t)+V0(u(i))), an d setting D{t) := |ii(t) + V^(u(i)) + ,4p| 2 , we obtain 

\Au(t)-Ap\ 2 = \(il(t)+V0(u(t))+Ap)+ 7 u(t)\ 2 

= D(t) + 7 2 K*)| 2 + 2j(u(t),u(t) + V0(u(t)) + Ap) 

= £>(t) + >f\u(t)\ 2 + 7^ (|n(t)| 2 + 20(«(t)) + 2(u(t) - p, Ap)) . 
Recalling that Ap = — V0(p) and by using the above equality, let us rewrite (|21|) as 

7i(f) + 7 /i(t) + (A7 2 - l)\u(t)\ 2 + AD(t) 

+A 7 |(|n(t)| 2 + 2^Kt))-2(n(t)-p,V0(p))) <0. (22) 

By using assumption A7 2 > 1, with D(t) > and ()22|) . we then get 

/»(*) + 7 fc(t) + A 7 ^ (|n(t)| 2 + 20(«(t)) - 2(u(t) - p, V0(p))) < 0, (23) 

which expresses that the function 

r (i) := h(t) + 7 /i(i) + A 7 (\u(t)\ 2 + 2<j,{u(t)) - 2(u(t) - p, V0(p)>) (24) 

is nonincreasing on [0, +00). Indeed, To(-) will serve us as a Liapunov function in 
the asymptotic analysis of (fTT|) . Let us first show the boundedness of trajectories. 
Note that by convexity of <j>, we obviously have 

<P(p) < <P(u(t)) - (u(t) - p, V0(p)>, (25) 

hence the nonincreasing property of To(-) leads to 

h(t) + jh(t) + A 7 (\u(t)\ 2 + 20(p)) < T (t) < r (0). (26) 

Set 

C := K -p||u | + %\uq -p| 2 + A7|u | 2 + 2A7(0(n o ) - <p{p) - (u -p, V<£(p))), 



which clearly satisfies 



Co > r (0) - 2A 7 ^(p). (27) 



From ([26]) and (f27"|) we deduce that /i(t) + 7 /i(i) < Co, so that, after integration, we 
obtain 

HQ = \Ht)-p\ 2 < \\u -p\ 2 + 2a, 
which shows that the trajectory i — ► remains bounded on [0, +00): 

sup \u(t)\ < +00. (28) 

te[o,+oo) 
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Let us now establish estimates on u and u. Integrating (|22p from to t, together 
with K25J yields 

h(t) + ~fh(t) + \-f\u(t)\ 2 

+(A 7 2 -1) C \u(s)\ 2 ds + A t \u{s) + V<p(u(s)) + Ap\ 2 ds < C , ( "" ! 
Jo Jo 

which implies h(t) + Xj\ii(t)\ 2 < Co- Equivalently, by definition of h(t), we have 

(u(t)-p,u(t)) + X 7 \u(t)\ 2 <C . (30) 

Since u(t) remains bounded on [0, +oo), inequality (j30j) implies that u(t) also remains 
bounded on [0,+oo): 

sup \u(t)\ < +oo. (31) 

te[o,+oo) 

From (|28|) . (f3Tj) and h(t) = (u(t) — p,ii(t)}, we observe that h(t) is bounded on 
[0, +oo). Returning to (f29l) we deduce that 

r+oo r+oo 

/ |w(s)| 2 ds < +oo and / \il(s) + V 4>(u(s)) + Ap\ 2 ds < +oo . (32) 
JO Jo 

Using that u and u are bounded on [0, +oo), together with the Lipschitz continuity 
property of A and equation ([3]), we deduce that it is also bounded: 

sup \u(t)\ < +oo. (33) 
te[o,+oo) 

Properties (f32|) and (f33j) express that the function g := u satisfies both 

g G L 2 (0, +oo; H) and 5 G L°°(0, +00; H). 
By a classical result, this implies lim^+oo g(t) = 0, that is, 

lim \u(t)\ = 0. (34) 

Returning to (J3j) -> by using that functions u and ii are Lipschitz continuous on [0, +00) 
(as their derivatives are uniformly bounded), that A is Lipschitz continuous and 
is Lipschitz continuous on bounded sets, we deduce that u is Lipschitz continuous on 
[0, +00). Once again, this property together with (j32|) implies that lim^ +00 \u(t) + 
V0(«(i)) + Ap\ = 0, which in light of © and ([HI) leads to 

lim \Au(t) - Ap\ = 0. (35) 

We have all the ingredients to conclude thanks to Opial's lemma, see [32 . To 
that end, we need to prove that properties (a) and (b) are fulfilled: 

(a) for every p £ S, lim^ +00 \u(t) — p\ exists; 

(b) for every t n — > +00 with u{t n ) — ^ u weakly in H, we have u £ S. 

Opial's lemma asserts that, under the above two properties, u(t) weakly converges 
as t — ► +00 to an element £ S. 
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Let us first prove (a). From (I20p and the monotonicity of A, we have 

h(t) + jh(t) + w{t) < \u(t)\ 2 , (36) 

where 

w(t) = (V0«i)) - V0(p), - p). 

It is obviously seen that w(t) is a nonnegative term (thanks to the monotonicity of 
V0), hence, from (|36f) . we immediately derive 

h(t) +jh(t) < \u(t)\ 2 . (37) 

By (I32p we know that |u| 2 belongs to L 1 (0, +oo;W). Noticing that fa is nonnegative, 
Lemma 12.31 shows that property (a) holds. 

Let us now prove (b). By (f36l) . after integration we obtain J +o ° w(s)ds < +oo. 
Owing to the Lipschitz continuity property of iv(-) we deduce that lim^ +00 w(t) = 0. 
On the other hand, by (i35j) we have lim^+oo \Au(t) — Ap\ = 0. We can now apply 
Lemma [2T21 to get property (b). • 

2.2 The strongly monotone case 

Let us recall that the operator V</> + A is called strongly monotone over bounded sets 
if, for all positive real number R, there exists a continuous function wr : IR+ — > IR+ 
verifying 

w R {t n ) -> => i n -> 0, 
and such that (u,w) £ W 2 with |w| < R and |u| < yields 

<(V0 + A)tt - (V</> + it - v) > w R {\u -v\). (38) 

Clearly, this property implies that S := (V(/> + A) _1 (0) contains at most one element 
and it holds if, for instance, or A is strongly monotone over bounded sets (with 
the other operator being assumed to be monotone). 

Proposition 2.1 Under the assumptions of Theorem \2.1\ assuming moreover that 
V(f)+A is strongly monotone over bounded sets, then the solution u(t) of Ul\) strongly 
converges as t goes to +oo towards the unique element of S := (V(/> + A) -1 (0). 

Proof: By Theorem 12. 1( we have u,u £ L°°([0, +oo); TL). Set R := sup 4>0 \u(t)\ + 
\p\, with p £ S, and combine ([20]) and (|38|) . to obtain h(t) + wji(\u(t) — p\) < 
|u(i)| 2 , where h(t) := (l/2)\u(t) — p\ 2 . After integration, observing that h £ 
L°°([0,+oo);H) and recalling that u G L 2 ([0, +oo);H) (Theorem ED (i2)), we de- 
duce that / +O ° w r(\ u ( s ) ~ P\)ds < +oo. On the other hand, by Theorem 12. 1\ (i4), 
linit^ +00 \u(t) —p\ exists, which by continuity of wr implies that lim^+oo WR(\u(t) — 
p\) exists. Hence, lim^ +00 wji(\u(t) — p\) = 0. Then use the property of wr 
(wR,{tn) — ► t n — ► 0) to obtain lim 4 ^ +00 \u(t) — p\ = 0, which ends the proof. • 
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2.3 Some particular cases 

Let us specialize Theorem 12.11 and Proposition 12.11 to some important particular 
situations. 

a) Let us first take the non-potential operator A equal to zero. Then notice 
that the null operator is A-cocoervive for any A > 0. By taking A > (I/7 2 ), we can 
apply Theorem 12. 1[ Owing to the fact that no restrictive assumption is made on the 
potential part, we obtain the Alvarez theorem [2]: 

Corollary 2.1 Let <f> : Ti — ► IR be a convex differentiable function whose gradient 
is Lipschitz continous on the bounded subsets ofTC, and letj > 0. Let us assume 
that S : = argmin w is nonempty. Then, for each initial data uq and vq in Ti, the 
unique solution u 6 C 2 ([0, +00); Ti) of 

u(*)+7u(t) + V0(«(t)) = O, (39) 

with initial conditions it(0) = no and u(0) = vq, satisfies: 

11) there exists Uoo £ S such that u(t) Uoo weakly inH as t — > +00; 

12) ii £ L 2 (0,+oo;Ti); lim t ^ +00 \u(t)\ = 0. 

b) Operators of the form A = I — T, where T : Ti — ► Ti is a contraction, play a 
central role in the realm of fixed point theory and constrained optimization. Let us 
verify that A is (l/2)-cocoercive. Indeed, by setting 

E := {{u-Tu) - (v -Tv),u-v) - \\{u-Tu) - (v-Tv)\ 2 , 

we obviously have 

E = {(u-v)- {Tu-Tv),u-v} - \\{u-v) - (Tu-Tv)\ 2 , 

= \u — v\ 2 — (Tu — Tv, u — v) — t;\u — v\ 2 — \\Tu — Tv\ 2 + ((u — v),Tu — Tv) , 
= \{\u-v\ 2 - \Tu-Tv\ 2 ), 

which, by contraction property of T, is nonnegative. Thus we can take A = 1/2, 
and condition ([5]) boils down to 7 > y/2. Applying Theorem 12.11 to this situation, 
we obtain the following result (see [5], Theorem 3.2): 

Corollary 2.2 Let T : Ti — > Ti be a contraction and 7 > y/2. Let us assume that 
S := FixT = {v E Ti : Tv = v} is nonempty. Then, for each initial data uo and vo 
in Ti, the unique solution u S C 2 ([0, +00); Ti) of 

u(t)+iu(t)+u{t)-T{u(t))=0, (40) 

with initial data u(0) = uq and u(0) = vq, satisfies: 

11) there exists Uoo £ FixT such that u(t) — 1 Uoo weakly inTi as t — > +00; 

12) ii e L 2 (0,+oo;Ti); lim t _ +00 \u(t)\ = lim^ +00 \u(t)\ = 0. 

c) When working with a general maximal monotone operator A : Ti — ► Ti, let 
us observe that, for every A > 0, its Yosida approximation A\ is A-cocoercive. We 
recall that A\ = j(L — Jjf), where := (/ + Avl) -1 is the resolvent operator 
of index A of A. The operator is everywhere defined, single-valued (it is a 
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contraction) and A x v 6 (4o J\)v for any v G TL (see [E]). Let (u,v) G W 2 and set 
£7 := ( A^-u — A\v, u — v) . Noticing that u = J^u + \A\u and v = J^v + A^v, an d 
recalling that A x u G j4(J^m) and A\v G j4(J^v), we immediately obtain 



E 



(a x u- A x v,(j£u- J a v) + \{A x u- A x v)) > X\A x u-A x v\ 2 , 



which proves that A x is A-cocoercive. Observing that A and A x have the same 
zeroes, and as a straight consequence of Theorem 12. H we reach the following result: 

Corollary 2.3 Let A : TL —* TL be a general maximal monotone operator and let 
7 > and A > be such that A7 2 > 1. Let us assume that S := A~ l {Q), the set or 
zeroes of A, is nonempty. Then, for each initial data uq and vq in TL, the unique 
solution u G C 2 ([0, +00); TL) of 

u{t) + ju(t) + A x {u(t)) = 0, (41) 

with initial data u(0) = uq and u(0) = Vq, A x being the Yosida approximation of 
index A of A, satisfies: 

il) there exists G S such that u(t) — Uoo weakly inTL as t — > +00; 

ill) u G L 2 (0,+oo;H); lim t ^ +00 = 0. 

Let us examine an interesting consequence of Corollary 12.31 regarding numerical 
schemes. Prom resolvent equation (see |19| . Proposition 2.6), we have (A x )^ = A x+pL 
whenever A > and [i > 0. Then it can be easily derived that, for any v G TC, 



J^ v = + J* , v . (42) 



Implicit time discretization of (|4ip naturally leads to a second order relaxed proximal 
algorithm, whose trajectories (sequences) converge to the set of zeroes j4 _1 (0), for 
A a general maximal monotone operator, see [3] and references herein. 

2.4 Condition ([5]) is sharp 

Let B : 1R 2 — ► IR 2 be the tt/2 rotation of center (0,0), namely B is the linear 
operator whose matrix in the canonical basis is given by 

B -- 



-1 

1 



Consider the dynamical system 

X(t) + 1 X(t) + B x X(t) = 0, (43) 

where 7 > and B x is the Yosida approximation of B of parameter A > 0. An easy 
computation shows that 

B * = rh H > where H= ( 1 "a 1 )- 
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The operator B\ is A-cocoercive, as follows from general properties of Yosida ap- 
proximation, or by a direct elementary computation. Let us compute explicitly the 
solutions of (|43p . The matrix H admits two complex conjugate eigenvalues. One of 
them is p\ = X—i, and it is associated to the eigenvector W\ = (1, i) T . Subsequently, 
searching for a solution of (|43|) of the form X{t) = e rt W\ (with r G C), we see that 
r satisfies the quadratic equation 



r + jr + 



A 



1 + A 2 



0. 



Equation (I44p has a complex discriminant A 
x and y are real values given by 



4A i 4i 
T+X 1 l+A 7 



(44) 



(x + iy) 2 , where 



i((7 2 -I^) + ^ 2 -w) 2 + H* 
(7 2 



1/2 



1 



I+A 7 



4A ) + V(7 2 :A 



1/2 



+ 



Hence (|44p has two complex solutions 



ri = (1/2) [(-7 - x) - iy] = oi - i&, 
r 2 = (1/2) [(-7 + x) + iy = a 2 + ib, 



where a%, a 2 and 6 are real values defined by 



7-^((7 2 -T^) + ^(7 2 -T^)^(^^) 
^(-7+^((7 2 -T^) + /(7^ 



1/2N 



1/2S 



4A 



16 

(T+A^F 
1/2 



16 
(T+A^F 



As a straightforward consequence, we deduce that a family of complex solutions to 
(|43l) is given by the functions {Vi,V^}, where V\{.) and V2G) are defined for any 
t G R by 



1 



3 (oi— i£))t 



„ai t 



cos bt — i sin 6i 
i cos fei + sin bt 



„ai t 



cos 6i 
sin bt 



+ i 



— sin bt 
cos fei 



1 



O (o,2+ib)t 



cos bt + i sin 6t 
i cos 6i — sin bt 



cos 6i 
— sin bt 



sin 6i 
cos bt 
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Note also that the complex conjugate of any solution to (|43f) is also a solution to 
(|43p . It is then immediate that a family of real solutions to (|43p is given by the 
functions {J7i, U%, U3, U4} defined for any t £ 1R by 



In light of these last results, we deduce that (f43l) will have non-convergent solutions 
if <i2 > 0, or equivalently if 



In addition, setting A = 6 /'y 2 (with 6 > 0), and after an easy computation, we obtain 
that (|45p is equivalent to 7 4 (1 — 6) > # 3 . Hence (|43p has non-convergent solution 
trajectories when € [0, 1), which means that A7 2 < 1 does not ensure convergence 
of dynamical system pip. 

2.5 Invariance of condition ([5]) with respect to time rescaling 

Given some positive real parameter k, let us consider the time rescaling t = ks. For 
any trajectory it(.) of (fTTj) . the rescaled trajectory v(s) = u(ks) satisfies 



Let us suppose that A is a A-cocoercive maximal monotone operator. One can easily 
verify that k 2 A is a (A//c 2 )-cocoercive maximal monotone operator. Clearly, this time 
rescaling does not change the asymptotic convergence properties of the trajectories. 
Indeed, the condition insuring the convergence of the trajectories, namely A7 2 > 1, 
remains invariant under this time rescaling, as shown by the following relation: 
(X/k 2 )x (7/c) 2 = A7 2 . This elementary observation tells us that the condition A7 2 > 1 
makes sense from a physical point of view. 

3 Asymptotic stabilization by Tikhonov regularization methods 

In order to correct some drawbacks of system ([3|), namely the weak (and possibly not 
strong) asymptotic convergence property of its trajectories, and the dependence of 
the limit equilibrium on the initial data, we introduce in the equation a Tikhonov- 
like regularization term with a vanishing coefficient. To be more precise, we are 
going to establish strong asymptotic convergence results regarding the solution of 
the non-autonomous system 






(45) 



v(s) + -ykv(s) + k 2 V(j)(v{s)) + k 2 



A(v{s)) = 0. 



(46) 



u{t) + 7 «(i) + V0(«(t)) + A(u(t)) + e(i)V0(«(i)) = 0, 



(47) 



u(0) = u , u(0) = v 
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where 7 > and (uo,Vq) in TL 2 are arbitrary given initial data. We make the 
following assumptions: 

(HI) <j) : TL — > 1R is a convex differentiable function whose gradient V</> is 
Lipschitz continous on bounded sets; 

(H2) A : TL — > TL is maximal monotone and A-cocoercive for some A > 0; 

(H3) e : [0, +00) — > (0, +00) is of class C 1 and tends to zero as t — > +00; 

(H4) : 7i — > IR is differentiable, convex and bounded below on TL, and its 
derivative V0 is 5-Lipschitz continuous (LC) and r/-strongly monotone 
(SM), with S > and rj > 0, i.e., 

(LC) |Ve(«)- V6(«)| <6\u-v\ Vu,veH, 
(SM) (V6(m) - ve(«),« - v) > 7]\u - v\ 2 Vu, v e W. 
At once, we claim the main result of this section. 

Theorem 3.1 Let us suppose that (H1)-(H4) hold with S := (A + V^) -1 ^) / 
and with A7 2 > 1. Let us assume moreover that e{t) is decreasing and converges 
slowly to zero as t — > +00 in the following sense: 

e{s)ds = +00. (48) 

Then, for any u$ and v$ in TL, there exists a unique solution u £ C 2 ([0, +00); TL) 
of f^7p which satisfies u(t) — > u* strongly in TL as t — > +00, where u* is the unique 
solution of the variational inequality: find S S such that 

(V8(u*),u- it*) > G S. 

Before proving Theorem l3.H we introduce a series of preliminary results. To begin 
with, we establish a key estimate on the trajectories of (|47p . 

Lemma 3.1 Under conditions (H1)-(H4), the solution u of f^Tp satisfies 

XG(t) + tu(i) + (A 7 2 - l)\u(t)\ 2 + f x(i) < 

-£(t)(V0(«(t)),«(t) -p) + 2A 7 e(i)9(«(t)), { ^ 

where p is any element in S := (A + V^) _1 (0), and G(.) are defined by 
w(t) = <V0(u(i)) - V0(p), u(i) - p), G(t) := \A(u(t)) + 7 u(t) - Ap\ 2 , 

Ti(-) denotes the first derivative of the mapping Ti(-) given by 

ri(t) = fc(t)+ 7 /i(*)+A 7 (|n(t)| 2 + 2 (0( u (*)) - («(t) - p, V0(p)» + 2e(t)&(u(t))), 

with h{t) = (l/2)|n(t) - p\ 2 , Q(v) := 0(v) - mf n G. 

Proof: Without ambiguity, in order to get simplified notations, we omit to write 
the variable t. Hence u stands for u(t), and so on. Taking p 6 S and using (147D . we 
have 

(V0(u) - X7(p(p),u -p) + {Au - Ap,u - p) = -{u + jii + e(t)V8(u),u - p), (50) 
which by A-cocoerciveness of A and by definition of w(t) amounts to 

\\Au- Ap\ 2 + w{t) < -{u + -yu,u-p) - e(t)(V9(u), u - p). (51) 
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Furthermore, from h = (l/2)\u— p\ 2 , we have h = (u,u — p) and h = (u,u—p) + \u\ 2 , 
so that h + 7 /i = (ii + 7 it, u — p) + |u| 2 . This combined with (|5ip gives 

A|Au - Ap\ 2 + + Ch + 7/1) < |«| 2 - e(t)(V@(u),u - p). (52) 

Let us reexpress \Au — Ap\ 2 with the help of (|47p : 

|Au - Ap| 2 = |ti + V </>(«) + e(i)V6(n) + Ap + 7 ti| 2 

= G(t) + 7 2 |n| 2 + 2 7 (u, ii + V0(«) + e(t)V0(«) + Ap), 1 j 

where := |ii + V0(«) + e(t)V0(«) + Ap| 2 (hence G(t) = \ Au(t) + ju{t) - Ap\ 2 ). 
Set G(.) =e(.)-inf«e, Q(t) = (l/2)\u\ 2 + (p(u) + (u - p, Ap), and rewrite fljjfy as 

\Au - Ap\ 2 = G(t) + 7 2 |n| 2 + 2 7 -^ (Q(t) + e(*)0(u)) - 2 7 e(t)6(u). 

Replacing this last expression in (|52p we obtain 

u;(t) + (/i + 7/1) + A (G(t) + 7 2 |w| 2 + 27| (Q(t) + £(*)©(«)) - 2 7 e(t)9(u)) 
< |u| 2 -e(t)(Ve(«),«-p), 

or equivalently 

w{t) + AG(t) + (A7 2 - l)|u| 2 + f i(t) < -e(t)(V9(ti),u - p) + 2A 7 e(t)6(n), 

where the function Ti(-) is defined by 

ri(i) = h(t) + jh(t) + 2A 7 (Q(t) + e(t)0(u(t))) 

= + 7 /i(t) + A 7 (|ti(t)| 2 + 2 (0(t*(t)) + <u(i) - p, Ap}) + 2e(t)6(«(t))) , 

which by Ap = -V^(p) leads to flM}. • 

We also need the following variant of Gronwall's inequality, see [23] (Lemma 1). 



Lemma 3.2 Let ip : [0, +00) — > 1R 6e absolutely continuous with 

iP(t) + e(t)ip{t) <e(t)g{t), a.e., 

where g(t) is bounded and e(t) > tuift e S Lj (H+). T/ien i/te function ip(t) is 
bounded and if J +o ° e(r)dT = +00 we have limsup t ^ +00 ^(i) < limsup < _ >+00 g(t). 

Proof: Let k s := sup{g(t) : t > s} so that ?/>(i) + e(t)[ip(t) — k s ] < for t > s. 
Multiplying by exp ^ /q e(T)drj and integrating over [s, i] we get [tp(t) — k s ] < [ip(s) — 

K s ] exp ^— /* e(T)dT^j . It follows that tp(t) is bounded and, if / +O ° e ( T )^ T = +00, by 
letting f — > +00 in the above estimate we obtain limsup t _> +00 ip(t) < k s . Letting 
s — ► +00 in this last inequality yields limsup t ^ +00 ip(t) < limsup t _ >+oc g(t). • 

At once we prove the boundedness of the trajectory given by (|47|) . 
Lemma 3.3 Let conditions (H1)-(H4) be satisfied with parameters such that 
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A7 2 > 1, e(t) < for all t > 0, and e(t) -> 0+ as t -> +00. 

Then for any solution u of |^7| ) it holds that 

u G L°°([0,+oo),W) and u G L°°([0, +00), W)- 
If m addition Jq + °° e(s)ds = +00, then the following properties are equivalent: 

(11) any weak cluster point of u(t) for t — ► +00 belongs to S := (V</> + j4) -1 (0), 

(12) liminf t _ ++0 o(Ve(n*),it(t) -«*) > 0, 
(iS) u(t) — ► ii* strongly, 

where u* is i/ie unique solution of $1Q\). 



Proof: Let us take p = u* in Lemma 13. 1 ^ use the same notations and set 

z(.) := (V6(m),u — it*), if (.) = <£(u) — (u — ti*, V^(ti*)), 
so that Ti = A + 7/1 + A7 (|tt| 2 + 2if + 2e(t)0(it)). With these notations, by using 
e < and @{u) > 0, Lemma 13 . 1 1 gives 

AG + w + (A 7 2 - l)|u| 2 + fi < -ez. (54) 

For any real values v > and p G (0, 1), by definition of Ti we also have 

id"i - z = (-z + prjh + ^2A7e6(ii)) + (uj - prf) h + ^A7|tt| 2 + vh + 2(\yv)K, 

which by (I54p amounts to 



AG + u> + (A7 2 - l)|u| 2 + f 1 + ueTi 

< e (-z + pr/h + ^2A7e9(ii)) + e (^7 - ^77) /i + ve\~f\u\ 2 + veh + 2e(\~fv)K. 

(55) 

By convexity of <j) and definition of if we have K (t) < <f>{u*) + w(t), while by Young's 
inequality h < (l/2)|-u| 2 + h. As a result, combining these last two inequalities with 
([55]) . we deduce that 

AG + (1 - 2A 7 ^e)u> + [A7 2 - 1 - ue(Xj + 1/2)] \u\ 2 + f 1 + ueV x . . 

< e (-z + prjh + 2XjueQ(u)) + e (^7 + v - prf) h + 2X~jve(f>{u*). ^ ' 

Hence, for v = {pn)/{^ + 1), we equivalently obtain 

AG + (1 - 2A 7 ^e)u; + (A7 2 - 1 - i/e_(A 7 + l/2))|u| 2 + f x + veY x (57) 
<e{-z-\-pr]h + 2vX^eQ(u))-\-2X^ve(j)(u se ). ^ ' 

Moreover, since A7 2 — 1 > and e(t) — > as t — ► +00, for t large enough, say t > to, 
we have A7 2 - 1 - z^e(t)(A7 + 1/2) > 0, l-2\jve(t) > 0, which by ([57} and positivity 
of G(-) (and omitting the variable t) leads to 

f 1 + veT x <e(-z + pr/h + 2A7^eG(u)) + 2\jve<l>(u*). (58) 

By convexity of O, we know that 

z > e(«) - e«), (59) 

while by r/-strong-monotonicity of V0 we have 

z> (V@(u*),u-u*) + 2r]h. (60) 
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From Young's inequality this latter inequality yields 

z > -(l/2r/)| V9(u*)| 2 + rjh. (61) 
Recalling that p £ (0, 1), and using ([59]) and (|6TI) . we obtain 

z > (1 - p)(Q» - G(u*)) - p(l/27?)|VeK)| 2 + pjjfc, (62) 
which by (j58|) amounts to 

Ti + < e ((1 - p)@(u*) + p(l/2 V )\VQ(u*)\ 2 ) 

-e ((1 - p) - 2\jve) e(u) + 2\jve<l>(u*). 

Observing that (1 — p) — 2Xji/e(t) > for t>t% large enough, we obtain 

Ti + veT x < e ((1 - p)Q(u*) + p(l/2 V )\ VG(u*)| 2 ) + 2A 7 z/e0(u*). (64) 

Applying Lemma 13.21 we deduce that Ti is bounded. By definition of T± and con- 
vexity of <p (note that 4>(u*) < K(t)) we have 

h{t) + 7 /i(t) + A 7 (\ii(t)\ 2 + 20(n,)) < ri(t). (65) 

Hence there exists a positive constant C such that i large enough, say t > t2, yields 

h(t) + ^h(t) + \ 7 \u(t)\ 2 <C, (66) 

which obviously implies that h is bounded on [0, +oo[, and so is u: 

sup \u(t)\ < +oo. (67) 

te[o,+oo) 

From h = (it, u — it*), ([66]) and ([67]) we also derive the boundedness of u: 

sup \u(t)\ < +oo. (68) 
te[o,+oo) 

Let us now prove the equivalences. Note that (il) => (i2) follows from (jlOp . while 
(i3) =4> (il) is obvious. It remains to prove (i2) => (i3). Let us assume that (i2) 
holds. Again from (|58p and (|60f) we immediately have 

ri + i/eri < e(-(Ve(n*),u--u,) + 2A7^e9(n)) + 2A 7 J/e0(u*) (69) 

which in light of Lemma 13.21 entails 

limsup^ +oo ri(t) 

< (l/^)limsup^ +00 [-(VG(^),n(t) -it*) + 2A 7 z/e(t)Q(u(i)) + 2A 7 i/</>(u*)] 
= (l/^)[2(A 7 i^)0(u*) - liminf t ^ +00 (VG(u*), w(i) - it*)]. 

It is then immediate that (i2) leads to limsup t ^ +00 Ti(t) < 2A 7 0(u*), which in light 
of ([65]) entails limsup i ^ +00 (h(t) + 7 /t(i)J < 0. Then, it is easily checked (one can 
apply Lemma [372]) that this inequality implies lim sup t ^ +00 h(t) = 0, namely (i3). • 
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We are now in position to prove convergence in norm of the trajectory of the 
solution u of (|4"7|) towards a special zero of V(p + A. 

Proof of Theorem 13.11 From Lemma 13.31 we know that 

u G L°°([0,+oo);W) and u G L°°([0, +oo); H). (70) 

By choosing p = u* in Lemma 13-H keeping the same notations, and setting K (t) = 
4>(u(t)) — (u(t) — u*, V<^(u*)), we recall that 

r x (t) = h(t) + 7 /»(t) + A 7 (\u(t)\ 2 + 2if(t) + 2e(t)6(n(t))), 

and we also have 

XG(t) + w(t) + (A 7 2 - l)\ii(t)\ 2 + TiW < -e(i)(Ve(u(i)), u(t) - u,). (71) 

The remainder of the proof will be divided into two cases: 

Case 1. Assume that there exists a time to such that the function Ti(-) is 
nonincreasing on [io,+oo). Then recalling that T\ is lower bounded (thanks to its 
definition and using ([TO]) ), we deduce that Ti(t) converges as t — > +oo to some real 
value a. This leads to limt_ > _t- 0O Ti (t) = 0. Indeed, for any reals t and s verifying 
t > s > to, we have /* |fi(r)|dr = — / s *fi (r)<ir = Ti(t) — Ti(s), hence, passing to 
the limit as t — > +oo, we get J^°° \Ti(t)\cIt = a — Ti(s) < +oo, and, by Lipschitz 
continuity of |ri(-)|, we conclude that Ti(t) — > as t — > +oo. Therefore, by ([7T]). 
the boundedness of u(-), together with A7 2 — 1 > and e(t) — > as t —>■ +00, we 
deduce that lim t ^ +00 w(t) = limt_ > _t_ 0O G(t) = lim^ +00 \u(t)\ = 0. It follows that 
limj^ +00 w(t) = and lim^+oo \ Au(t) — Au*\ = 0. Hence, in light of Lemma 12.21 
we observe that any weak cluster point of u belongs to S, which by Lemma [3 .31 shows 
that u(t) — ► u* strongly. 

Case 2. Assume that there exists an increasing sequence (4) C [0, +00) such 
that lim^oo 1^ = +00 and ri(Zfc) > for all k > 0. This allows us to introduce the 
mapping s : [0, +00) — > [0, +00) defined for t large enough by 

s(t) = sup{/3 < t I fi(/3)>0}, 

and we establish that limsup 4 ^ +00 Ti(t) < 0. Let (t n ) C [0, +00) be a sequence 
such that lim n ^ +00 t n = +00, and set s n = s(t n ). It is obviously seen that (s n ) is a 
nondecreasing sequence such that s n — ► +00 as n — > +00, (ri(s n )) C [0, +00), while 
by (|7ip we have 

AG(s n ) + u;(s n ) + (A7 2 - l)Rsn)| 2 < -e(s n )(Ve(u(s n )),u(s n ) - u»). (72) 

From this last inequality, keeping in mind that A7 2 — 1 > and e(s n ) — ► as n — > 00, 
we obviously deduce that 

lim |tt(s n )| = lim w(s n ) = lim |Au(s n ) — ^4u*| = 0. (73) 
By using e(s n ) G (0, +00), we additionally obtain 



(ve(«(s„)),«(s n )-w t ) < 0. 



(74) 
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Clearly, (f73l) entails that any weak-cluster point of u(s n ) belongs to S (according to 
Lemma l2.2p . while by (|74p and using the 77-strong monotonicity of VG, we obtain 

r]\u(s n ) - it*| 2 < (V6(u(s„)) - VG(u*),it(s n ) - it*) < -(V0(u*), it(s n ) - it*}. 

Hence 

limsup ( rj\u(s n ) — u*| 2 ) < — liminf (V9(u*), u(s n ) — it*) < 0, 
rc-*+ao v ' n->+oc 

this last inequality being obtained by passing to the limit on a weak convergent 
subsequence of u(s n ), using the fact that any weak-cluster point of it(s n ) belongs 
to S and the definition ([TO]) of u*. Hence it(s n ) — ► u* strongly, which together with 
(|73l) and the definition of l?i implies that 

lim ri(s„) = 2A 7 0(w*). (75) 

71— »+oo 

In addition, using the definition of s(i n ) we clearly have s n < i n and Ti(t) < 
for t €]s(t n ),t n [ when s(i n ) 7^ t n . Let us write Ti(t n ) = Ti(s n ) + f* n Ti(t)dt < 
Fi(s n ), which by ([731) yields limsup n _ +00 Ti(t n ) < 2A70(it*). By convexity of <fi 
h(t) + jh(t) + 2A 7 0(it*) < ri(t), which yields limsup^^ (h(t n ) + 7/i(i n )) < 0. 
This being true for any sequence (t n ) that converges to infinity, we conclude that 
limsup t ^ +00 (/i(t) +~fh(t)) < 0, which immediately leads to u(t) — > it* strongly . • 

The case Q(v) = ^M 2 , which corresponds to the classical Tikhonov regulariza- 
tion method, has been the object of active research, especially in the case of first 
order dynamical systems governed by maximal monotone operators, see |23] for some 
advanced results and references. Concerning second order dynamics, the potential 
case has been considered in [13] . Let us now state an extension of this last result to 
the non-potential case. 

Corollary 3.1 Let us suppose that (H1)-(H3) hold with S := (V</> + ^) _1 (°) / $ 
and with A7 2 > 1. Let us assume moreover that e(t) is decreasing and converges 
slowly to zero as t — > +00 in the following sense: 

r+00 

/ e(s)ds = +00. (76) 
Jo 

Then, for any uq and vq in 7i, there exists a unique solution it G C 2 ([0, +00); TC) of 

fi(t) + 7«(t) + V<j)(u(t)) + A(u(t)) + e(t)u(t) = 0, (77) 

with it(0) = ito and ?i(0) = vq, which satisfies u(t) — > it* strongly inH as t — > +00, 
where u* is the element of minimal norm of the closed convex set S. 

4 Examples 

The following examples aim at illustrating our abstract results. Each of them re- 
quires further studies which are out of the scope of the present article. 
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4.1 Constrained optimization 

Let C be a closed convex subset of Ti., and j:W-*Ra convex continuously differ- 
entiable function, whose gradient Vg is Lipschitz continuous over Ti with Lipschitz 
constant L. Let us consider the constrained optimization problem 

min {g(v) : v £ C} . (78) 

Because of their direct linking with numerical gradient methods, we are interested in 
the study of smooth dissipative dynamical systems whose trajectories asymptotically 
converge towards minimizers of (]78p . Considering second-order dynamics aims at 
making the algorithms faster. 

Let us denote by S the set of solutions of (f78j) and suppose that S ^ 0. A first-order 
optimality condition for (|78[) is given by the following inclusion 

Vg(u) + N c (u) B 0, (79) 

where Nq(u) is the outward normal cone to C at u 6 C. Observe that (I79j) is 
equivalent to 

u-P c [u-fiVg{u)]=0, (80) 

where Pc is the projection operator on C and [i is a positive parameter. Whence 
we considerer the following gradient-projection dynamic 

u(t) + 7 u(t) + u(t) - P c [u(t) - u.Vg(u(t))} = 0. (81) 

This continuous dynamical system has been first introduced by Antipin [8] and 
further studied by Attouch- Alvarez [5]. An extended study of the corresponding 
first-order system has been achieved in [T7], [18]. Let us show that the operator 

Av:=v-P c (v- fiVg{v)) (82) 

is (l/2)-cocoercive for < n. < (2/L). To that end, let us notice that A = I — T 
where Tv = Pc(v — fiVg(v)). According to Corollary 12.21 an d noticing that Pc is a 
contraction, we just need to verify that the mapping v i— ► v — /j,Vg(v) is a contraction 
too. Given arbitrary u £ TC, v G TC, we have 

\{u-uXJg(u))-{v-uXJg(v))\ 2 

= \u-v\ 2 - 2^{Vg{u) -Vg(v),u-v) + n 2 \Vg(u) -Vg(v)\ 2 . 

Thus proving that v i— ► v — [iSJg(v) is a contraction, is equivalent to prove that 
(Vg(u) — Vg(v ), u — v) > ^\Vg(u) — Vg(v)\ 2 , which amounts to say that V<? is 
(/u/2)-cocoercive. Clearly, this property forces Vg to be (2//x)-Lipschitz continuous. 
Indeed, as a striking property, the converse statement holds true for the gradient of a 
convex function, that's the Baillon-Haddad theorem, see |16| . Hence Vg being Lips- 
chitz continous with Lipschitz constant L < (2//i) forces Vg to be (/x/2)-cocoercive. 

Hence (j8T|) falls in our setting. Applying Theorem 12.11 with A = 1/2, we deduce 
that, for 7 > \[2 and < /x < (2/L), every trajectory of (f8Tj) weakly converges to 
an element of S, which is a minimizer of problem (|78p . 
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Moreover, when considering the Tikhonov-like regularized dynamic with e(t) — > 
as t goes to +00, 

u(t) + jii(t) + u(t) - P C [u(t) - nVg(u(t))] + e(t)Ve(u(t)) = 0, (83) 

by a direct application of Theorem 13.11 under the assumption f^ 00 e(s)ds = +00, 
one obtains that the trajectories of ([83]) strongly converge to the unique solution 
u £ S verifying 

6(0) = inf 0(t,). (84) 
v £ S 

Remark Inertial dynamical systems, like the "heavy ball with friction dynamical 
system" have been first introduced by B. Polyak [33] in the realm of optimiza- 
tion. Since then, an abundant literature has been devoted to this subject. Rich 
connections between second order dissipative dynamical systems in their respective 
continuous and discretized forms have been put to the fore, and so provide new 
algorithms together with a deeper insight into their convergence analysis, see [2J, 

®,®,m, m, m, m, m, na, m- 

4.2 Coupled systems and dynamical games 

Throughout this section we make the following standing assumptions: 

• 7i = X\ x X 2 is the cartesian product of two Hilbert spaces equipped with 
norms \ \x\ and |.|;t 2 , while x = {x\, X2), with x\ £ X\ and X2 G stands for 
any element in 7i; 

• <j>{x) = f\{xi) + f 2 (x 2 ) + $(xi,x 2 ), where fi : X 1 -> M, f 2 : X 2 ->■ 1R are 
smooth convex functions, $ : X\ x X 2 — > IR is a smooth convex coupling 
function; 

• A = (V Xl £, — 1 \J X2 C) is the maximal monotone operator which is attached to a 
smooth convex-concave function C : X\ x X 2 — ► IR. The operator A is assumed 
to be A-cocoercive for some A > 0. 

A typical example of coupling function $ (see [10] ) is given by 

$(x) = \\L x x\ -L 2 x 2 \%, 

where L\ G L(X±,Z) and L 2 £ L(X 2 ,Z) are linear continuous operators acting 
respectively from X\ and X 2 into a third Hilbert space Z with norm \ \z- 
A smooth convex-concave function C, such that the associated maximal monotone 
operator A is A-cocoercive, can be obtained in a systematic way by using epi-hypo 
Moreau-Yosida regularization, as described below. Given a general closed convex- 
convave function C : X\ x X 2 — > IR (see [34]) and a positive parameter A, we consider 
C\ : X\ x X 2 — > IR defined for any [x%, x 2 ) £ X\ x X 2 by 

L\{x x ,x 2 ) = min max \ C(u!,u 2 ) + ^-\xi - ui\ 2 x - ^-\x 2 - u 2 \ 2 x \ . 
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Then C\ is a smooth convex-concave function whose associated maximal monotone 
operator (V Xl £\, —V X2 £\) is precisely the Yosida approximation A\ of the operator 
A = (d Xl C, —d X2 C), i.e., A\ = (V Xl £\, —V X2 £\) (see [9] for further details). 
In this setting, with u{t) = (xi(i), X2(t)) system ([3]) becomes 



' xi(t) +7ii(t) + V/i(xi(t)) + V Xl $(xi(t),x 2 (*)) + V xl C{xx(t),x 2 (t)) = 0, 

(85) 

. x 2 {t) + -yx 2 {t) + V/ 2 (x 2 (i)) + V xa $(xi(t),x 2 (t)) - V xa £(xi(*),s 2 (t)) = 0. 

As a straight application of Theorem 12. H assuming relation A7 2 > 1 holds, one 
obtains x(t) = (xi(t), x 2 (t)) — ► Xqo = (xi j00 , x 2 ,oo) weakly in K as t goes to +00, 
where (xi j00 , x 2 ,oo) is solution of the coupled system 

f V/i(xi) + V xi $(xi,x 2 ) + V Xl C(x 1 ,x 2 ) = 0, 

< (86) 

I V/ 2 (x 2 ) + Va, a *(a;i, x 2 ) - V X2 £(xi, x 2 ) = 0. 

Structured systems such as (f86l) contain both potential and non-potential terms 
whose antagonistic effects are often present in decision sciences and physics. 

In game theory, (186j) describes Nash equilibria of the normal form game with two 
players 1, 2 whose static loss functions are respectively given by 

f F 1 : (xi,x 2 ) € Xi x X 2 ->• -Fi(xi,x 2 ) = /i(xi) + $(xi,x 2 ) + £(xi,x 2 ), 

i (87) 

[ F 2 : (xi,x 2 ) G ^1 x X 2 ->■ F 2 (xi,x 2 ) = / 2 (x 2 ) + $(xi,x 2 ) - £(xi,x 2 ), 

where the represent the individual convex payoffs of the players, *£(.,.) is their 
joint convex payoff, and £ is a convex-concave payoff with zero-sum rule. The case 
C = corresponds to a potential team game (see [31]), while case $ = corresponds 
to a non cooperative zero-sum game. Game (]87p involves both cooperative and non 
cooperative aspects. 

A central question in game theory, decision sciences and economics is to describe 
realistic dynamics which converge to Nash equilibria, see [29] and the references 
herein. Indeed, implicit time discretization of dynamical system (I85p leads to the 
following best response dynamics (players 1 and 2 play alternatively) with inertia 
and "costs to change" 

(^1^+17^2^+1) - * ( x l,k+2, x 2,k+l) (xi : k+2,X 2: k +2 ); 

xi,k+2 = argmin 5&Yl {/i(£) + $(£,x 2>fc+ i) + £(£, x 2jfe+ i) 

+ 2^7 II £ ~ ( x l,k+l + Pk(xi,k+1 ~ X lt k)) \\ 2 Xl }, 

x 2 ,k+2 = argmin r?eA . 2 {/ 2 (??) + $(xi jjfc+2 , 77) - £(x lifc+2 , 77) 

+ 27^ II »7 ~ (^2,fc+i + Pk(x 2 , k +i ~ x 2 ,k)) \\x 2 }- 

The terms || ^ - xi )fc+ i - /3 fc (xi )fc +i - xi )fc ) || 2 and || rj - x 2 ,k+i - Pk(x 2 ,k+i ~ x 2,fc) || 2 
naturally come into play when discretizing first and second order time derivatives, 
see [2], [3]. In decision sciences, they reflect some aspects of agents behaviors like 
anchoring and inertia, and can be interpreted as "low local costs to change", see 
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[10] . [15] . The various parameters ctk, Vk, fik model adaptive, learning abilities of the 
agents as well as their reactivity or resistance to change. 

Continuous dynamical system (j85[) together with its convergence properties offers 
a valuable guideline to study discrete dynamic ([88]) . Clearly, this requires further 
study beyond the limit of the present paper. 

4.3 Further perspectives 

It is natural to relax the regularity assumptions on the potential operator V<^ and the 
maximal monotone operator A, and to wonder whether our asymptotic convergence 
results remain valid in respect of the more general differential inclusion 

u(t) + 7«(i) + Au(t) + d(j){u(t)) 3 0. (89) 

Let us give some precisions (regarding cases when either A or d<j) is single- valued) : 
1. The non-smooth potential case (obtained by taking A = 0) , that is 

u(t) + 7«(i) + dcj){u{t)) B 0, (90) 

has been considered in the finite dimensional case in Trajectories of (|90h nat- 
urally exhibit elastic shocks, which makes this system play an important role in 
unilateral mechanics, see [35!. Taking equal to the indicator function of a closed 
convex set C yields (damped) billiard dynamics. Given a non-smooth closed convex 
potential <p : H — > H U {+00} and a A-cocoercive operator A, a natural approach 
to (|89[) (in the same lines as |35j ) would consist in approximating <p by smooth 
convex functions <f> n (this is always possible for example via Moreau-Yosida approx- 
imation), which leads to study 

u n {t) + 7Un(t) + Au n {t) + V<j) n {lL n {t)) = 0. (91) 

Note that our basic assumption A7 2 > 1, which does not concern the potential 
part of the operator, is not affected by this operation. Thus, ([9T]) falls in our setting. 
Then, one has to establish estimations on the sequence (u n ), pass to the limit on 
these estimations as n goes to infinity, and derive conclusions on the asymptotic 
behavior of trajectories of (|89p . As it has been done in [6] and [TTJ, this program 
would allow to consider the asymptotic behavior of damped hyperbolic equations 
(with non-isolated equilibria) combining potential with non potential effects. 

2. The study of ([89ft with a general maximal monotone operator A leads to 
considerable difficulties. In that case, another type of regularization or relaxation 
method can be used. It relies on the following remark. Let A > and 7 > 
(being fixed) such that A7 2 > 1, A\ the Yosida approximation of A, and consider 
the equation 

u(t) + tu(*) + V0(u(t)) + A x (u{t)) = 0. (92) 

Equation ([92]) enters our setting (as A\ is A-cocoercive) and it can be equivalently 
rewritten as 

u(t)+ 1 u(t)+V^(u(t)) + ±{u(t)-v(t)) = 0, 
Av(t) + Uv(t) - u(t)) 3 0. 
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This naturally suggests that some of our results can be extended to coupled 
systems of the following type 

fi(t) + yu(t) + V0(u(t)) + \{u(t) - v(t)) = 0, 

+ Av(t) + - u(t)) 9 0. 

Our approach, which is based on Liapunov methods, (|28j. [21], [27]), can be adapted 
to such nonlinear systems. In the case of linear hyperbolic PDE's, it would be 
worthwhile to compare it with spectral analysis methods, see for example |24j . [26]. 

3. In view of further applications, it would be interesting to consider other 
types of dissipation phenomena: For example, dry friction most likely produces 
stabilization within finite time, a desirable feature of human decision processes, see 
PQ. Geometrical damping is of great importance for numerical optimization, and 
modeling of non elastic shocks in mechanics, see |7J. 
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